Back

Journal of Medical Imaging

SPIE-Intl Soc Optical Eng

All preprints, ranked by how well they match Journal of Medical Imaging's content profile, based on 11 papers previously published here. The average preprint has a 0.01% match score for this journal, so anything above that is already an above-average fit. Older preprints may already have been published elsewhere.

1
Low-Cost, Label-Free Blue Light Cystoscopy through Digital Staining of White Light Cystoscopy Videos

Chang, S.; Wintergerst, G. A.; Carlson, C. J.; Yin, H.; Scarpato, K. R.; Luckenbaugh, A. N.; Chang, S.; Kolouri, S.; Bowden, A. K.

2024-03-22 urology 10.1101/2024.03.21.24304656 medRxiv
Top 0.1%
40.7%
Show abstract

Bladder cancer is 10th most common malignancy and carries the highest treatment cost among all cancers. The high cost of bladder cancer treatment stems from its high recurrence rate, which necessitates frequent surveillance. White light cystoscopy (WLC), the standard of care surveillance tool to examine the bladder for lesions, has limited sensitivity for early-stage bladder cancer. Blue light cystoscopy (BLC) utilizes a fluorescent dye to induce contrast in cancerous regions, improving the sensitivity of detection by 43%. Nevertheless, the added cost and lengthy administration time of the dye limits the availability of BLC for surveillance. Here, we report the first demonstration of digital staining on clinical endoscopy videos collected with standard-of-care clinical equipment to convert WLC images to accurate BLC-like images. We introduce key pre-processing steps to circumvent color and brightness variations in clinical datasets needed for successful model performance; the results show excellent qualitative and quantitative agreement of the digitally stained WLC (dsWLC) images with ground truth BLC images as measured through staining accuracy analysis and color consistency assessment. In short, dsWLC can provide the fluorescent contrast needed to improve the detection sensitivity of bladder cancer, thereby increasing the accessibility of BLC contrast for bladder cancer surveillance use without the cost and time burden associated with the dye and specialized equipment.

2
Cracks in the Foundation: How Data-Hungry and Sensitive to Domain Shift are Vision Foundation Models for Computational Pathology?

Bonn, S.; Zimmermann, M.; Sauter, G.; Bengtsson, E.; Huber, T. B.; Baumbach, J.; Lennartz, M.; Fuhlert, P.; Witte, A.

2026-01-06 urology 10.64898/2026.01.06.25342815 medRxiv
Top 0.1%
29.1%
Show abstract

BackgroundVision Foundation Models (VFM) have emerged as a promising approach for computational pathology, offering scalable feature representations that may reduce labelled-data requirements and improve robustness to variation in tissue preparation and digitisation. However, VFM decoder and dataset size requirements as well as the performance under real-world domain shifts remain unclear. MethodsWe evaluated six contemporary VFMs on a protocol-variant Prostate Cancer (PCa) dataset comprising 37 683 tissue microarray spot images from 10 412 patients. The dataset includes six controlled domain shifts arising from differences in staining duration, section thickness, scanner type, and sampling location. Two clinically relevant downstream tasks were examined: ISUP grading and 5-year relapse prediction. We compared two decoder architectures, quantified dataset-size requirements using a saturation analysis (45-5727 samples), and assessed cross-domain robustness using out-of-domain test sets. FindingsLarger VFMs consistently outperformed smaller models in peak accuracy and robustness metrics. Contrary to expectations of data efficiency, all models showed strong dependence on training-set size, requiring at least 1000 samples to approach stable results. All VFMs showed notable degradation under protocol-level domain shifts, with performance reductions of 4 to 13 percentage points in both cancer grading and relapse prediction, although larger models exhibited somewhat greater robustness. Furthermore, KNN-based probing performed substantially worse than a decoder-based approach across all architectures. InterpretationsDespite their strong representational capacity, current VFMs do not yet provide reliable domain generalisation or data-efficient performance in computational pathology. Decoder design remains essential, and substantial amounts of labelled data are still required to achieve clinically meaningful accuracy. Further advances in pre-training strategies, decoder architectures, and domain adaptation methods will be crucial for translating VFMs into robust clinical tools. Research in contextO_ST_ABSEvidence before this studyC_ST_ABSThis study focuses on pathology foundation models, which offer promising improvements in performance, data requirements, and robustness to domain shifts for computational pathology. To identify relevant studies, we searched in Google Scholar for research published before 1 April 2025. We searched for studies introducing novel foundation models trained on pathology images, or reviews comparing those models in terms of performance or robustness. The search terms used were computational pathology, benchmarking, review and foundation model, as well combinations of these terms. We found that many studies focus on increasing the complexity of pathology foundation models while using increasingly extensive and heterogeneous pre-training datasets. Various benchmarking studies demonstrate the superior performance and robustness of more recent and larger foundation models. However, these studies have limitations in their evaluation datasets. Either they cover only a domain shift due to a different scanner device, or they have small sample sizes. We also identified a research gap regarding the requirement for large datasets to train a decoder based on a pathology foundation model for a specific downstream task. Added value of this studyThe goal of this study was to evaluate the necessity of large downstream task datasets and the domain shift robustness of multiple pathology foundation models. For this purpose, we used our internal protocol-variant prostate cancer dataset, which provides a controlled evaluation setup as multiple domain shift types have been intentionally and separately introduced for different sub-datasets. Our saturation analysis revealed that at least 1000 samples were necessary to achieve good performance. Furthermore, our findings show that none of the evaluated foundation models are robust against all of our domain shifts, though larger models generally perform better. Implications of all the available evidenceThis study reveals that increasing the capacity of pathology foundation models improves performance and robustness. However, we demonstrated that all models exhibit some degree of performance degradation for certain domain shifts and require substantial datasets for training on downstream tasks. These limitations demonstrate that pathology foundation models do not fully address the issues of robustness and data requirements.

3
High-performing Multi-task Model of Urinary Tract Dilation (UTD) Classification for Neonatal Ultrasound Reports Through Natural Language Processing

Hua, Y.; Mukkamala, A.; Estrada, C.; Li, M. L.; Wang, H.-H.

2024-01-24 urology 10.1101/2024.01.23.24301680 medRxiv
Top 0.1%
19.3%
Show abstract

ObjectiveThe urinary tract dilation (UTD) classification system provides objective assessment relevant to hydronephrosis management for children. However, the lack of uniform language regarding UTD in radiology reports leads to significant difficulty in both clinical management and research. We seek to develop a unified multi-task/multi-class model that can effectively extract UTD components and classifications from early postnatal ultrasound (US) reports. MethodsRadiology records from our institution were reviewed to identify infants aged 0-90 days undergoing early ultrasound for antenatal UTD. The report and images were reviewed by the study team to create the ground truth of UTD classification and components (primary outcome). Bio_ClinicalBERT, a variant of the Bidirectional Encoder Representations from Transformers (BERT) model, was used as the embedding layers of the classification model. The model was fine-tuned with 11 linear classification layers. All but the last BERT layer were frozen during the fine-tuning process. The model performance was evaluated with five-fold cross-validation with an 80:20 train-test ratio. Results2460 early (0-90 days) US reports were included. The five-fold cross-validated model performance is satisfactory (Weighted F1 > 0.9 for all UTD components). We report the weighted F1 scores, accuracies, and standard deviations for all 11 tasks and their average performance. ConclusionsBy applying deep state-of-the-art NLP neural networks, we developed a high-performing, efficient, and scalable solution to extract UTD components from unstructured ultrasound reports using one single multi-task model. This can potentially help standardize and facilitate large-scale computer vision research for pediatric hydronephrosis. Key Words: machine learning, efficiency, ambulatory care, forecasting

4
Conditional Generative Learning for Medical Image Imputation

Raad, R.; Ray, D.; Varghese, B.; Hwang, D.; Gill, I.; Duddalwar, V.; Oberai, A. A.

2023-04-05 cancer biology 10.1101/2023.04.03.535422 medRxiv
Top 0.1%
15.3%
Show abstract

Image imputation refers to the task of generating a type of medical image given images of another type. This task becomes challenging when the difference between the available images, and the image to be imputed is large. In this manuscript, one such application, derived from the dynamic contrast enhanced computed tomography (CECT) imaging of the kidneys, is considered: given an incomplete sequence of three CECT images, we are required to the impute the missing image. This task is posed as one of probabilistic inference and a generative algorithm to generate samples of the imputed image, conditioned on the available images, is developed, trained, and tested. The output of this algorithm is the "best guess" of the imputed image, and a pixel-wise image of variance in the imputation. It is demonstrated that this best guess is more accurate than those generated by other, deterministic deep-learning based algorithms, including ones which utilize additional information and more complex loss terms. It is also shown the pixel-wise variance image, which quantifies the confidence in the reconstruction, can be used to determine whether the result of the imputation meets a specified accuracy threshold and is therefore appropriate for a downstream task.

5
Generative modeling of histology tissue reduces human annotation effort for segmentation model development.

Lutnick, B. R.; Sarder, P.

2021-10-16 pathology 10.1101/2021.10.15.464564 medRxiv
Top 0.1%
13.4%
Show abstract

Segmentation of histology tissue whole side images is an important step for tissue analysis. Given enough annotated training data modern neural networks are capable accurate reproducible segmentation, however, the annotation of training datasets is time consuming. Techniques such as human in the loop annotation attempt to reduce this annotation burden, but still require a large amount of initial annotation. Semi-supervised learning, a technique which leverages both labeled and unlabeled data to learn features has shown promise for easing the burden of annotation. Towards this goal, we employ a recently published semi-supervised method: datasetGAN for the segmentation of glomeruli from renal biopsy images. We compare the performance of models trained using datasetGAN and traditional annotation and show that datasetGAN significantly reduces the amount of annotation required to develop a highly performing segmentation model. We also explore the usefulness of using datasetGAN for transfer learning and find that this greatly enhances the performance when a limited number of whole slide images are used for training.

6
Self-supervised Learning for Chest CT - Training Strategies and Effect on Downstream Applications

Tariq, A.; Patel, B.; Banerjee, I.

2024-02-05 radiology and imaging 10.1101/2024.02.01.24302144 medRxiv
Top 0.1%
13.3%
Show abstract

Self-supervised pretraining can reduce the amount of labeled training data needed by pre-learning fundamental visual characteristics of the medical imaging data. In this study, we investigate several self-supervised training strategies for chest computed tomography exams and their effects of downstream applications. we bench-mark five well-known self-supervision strategies (masked image region prediction, next slice prediction, rotation prediction, flip prediction and denoising) on 15M chest CT slices collected from four sites of Mayo Clinic enterprise. These models were evaluated for two downstream tasks on public datasets; pulmonary embolism (PE) detection (classification) and lung nodule segmentation. Image embeddings generated by these models were also evaluated for prediction of patient age, race, and gender to study inherent biases in models understanding of chest CT exams. Use of pretraining weights, especially masked regions prediction based weights, improved performance and reduced computational effort needed for downstream tasks compared to task-specific state-of-the-art (SOTA) models. Performance improvement for PE detection was observed for training dataset sizes as large as [Formula] with maximum gain of 5% over SOTA. Segmentation model initialized with pretraining weights learned twice as fast as randomly initialized model. While gender and age predictors built using self-supervised training weights showed no performance improvement over randomly initialized predictors, the race predictor experienced a 10% performance boost when using self-supervised training weights. We released models and weights under open-source academic license. These models can then be finetuned with limited task-specific annotated data for a variety of downstream imaging tasks thus accelerating research in biomedical imaging informatics.

7
Learning to leverage salient regions in neuro-oncology using Deap Learning

Grigis, A.; Alentorn, A.; Frouin, V.

2020-10-23 cancer biology 10.1101/2020.10.22.350421 medRxiv
Top 0.1%
12.9%
Show abstract

Developing an automatic tumor detector for MRI medical images is a major challenge in neuro-oncology. The availability of such a tool would be a valuable assistance for the radiologists. Numerous works have tried to segment the tumor tissues, others have attempted to localize the tumor globally. In this work we focus on this second class of methods and we compare two drastically different strategies. The first one is an assumption-free anomaly detector build over a Variational Auto-Encoder (VAE), and the second one is a VGG classifier that embed Attention-Gated (AG) units to focus on the target structures at almost no additional computational cost. This comparison is first conducted on the publicly available BraTS glioma dataset for which published performance results can serve as reference, and extended as such (ie., without transfer learning) to two internal image datasets, namely Primary Central Nervous System Lymphoma (PCNSL) and Metastasis. The results demonstrate that the VAE and AG-VGG strategies can be used, up to a certain extent, to localize brain tumors.

8
COVision: Convolutional Neural Network for the Differentiation of COVID-19 from Common Pulmonary Conditions using CT Scans

Parikh, K.; Mathew, T. J.

2023-01-23 radiology and imaging 10.1101/2023.01.22.23284880 medRxiv
Top 0.1%
12.8%
Show abstract

With the growing amount of COVID-19 cases, especially in developing countries with limited medical resources, it is essential to accurately and efficiently diagnose COVID-19. Due to characteristic ground-glass opacities (GGOs) and other types of lesions being present in both COVID-19 and other acute lung diseases, misdiagnosis occurs often -- 26.6% of the time in manual interpretations of CT scans. Current deep-learning models can identify COVID-19 but cannot distinguish it from other common lung diseases like bacterial pneumonia. Concretely, COVision is a deep-learning model that can differentiate COVID-19 from other common lung diseases, with high specificity using CT scans and other clinical factors. COVision was designed to minimize overfitting and complexity by decreasing the number of hidden layers and trainable parameters while still achieving superior performance. Our model consists of two parts: the CNN which analyzes CT scans and the CFNN (clinical factors neural network) which analyzes clinical factors such as age, gender, etc. Using federated averaging, we ensembled our CNN with the CFNN to create a comprehensive diagnostic tool. After training, our CNN achieved an accuracy of 95.8% and our CFNN achieved an accuracy of 88.75% on a validation set. We found a statistical significance that COVision performs better than three independent radiologists with at least 10 years of experience, especially in differentiating COVID-19 from pneumonia. We analyzed our CNNs activation maps through Grad-CAMs and found that lesions in COVID-19 presented peripherally, closer to the pleura, whereas pneumonia lesions presented centrally.

9
Synthetic Histology Images for Training AI Models: A Novel Approach to Improve Prostate Cancer Diagnosis

Van Booven, D. J.; Chen, C.-B.; Kryvenko, O.; Punnen, S.; Sandoval, V.; Malpani, S.; Noman, A.; Ismael, F.; Briseno, A.; Wang, Y.; Arora, H.

2024-01-29 cancer biology 10.1101/2024.01.25.577225 medRxiv
Top 0.1%
12.5%
Show abstract

Prostate cancer (PCa) poses significant challenges for timely diagnosis and prognosis, leading to high mortality rates and increased disease risk and treatment costs. Recent advancements in machine learning and digital imagery offer promising potential for developing automated and objective assessment pipelines that can reduce human capital and resource costs. However, the reliance of AI models on large amounts of clinical data for training presents a significant challenge, as this data is often biased, lacking diversity, and not readily available. Here we aim to address this limitation by employing customized generative adversarial network (GAN) models to produce high-quality synthetic images of different PCa grades (radical prostatectomy (RP)) and needle biopsies, which were customized to account for the granularity associated with each Gleason grade. The generated images were subjected to multiple rounds of benchmarking, quantifications and quality control assessment before being used to train an AI model (EfficientNet) for grading digital histology images of adenocarcinoma specimens (RP sections) and needle biopsies obtained from the PANDA challenge repository. Validation was performed using the AI model trained with synthetic data to grade digital histology from the cancer genome atlas (TCGA) (RP sections) and needle biopsy data from Radboud University Medical Center and Karolinska Institute. Results demonstrated that the AI model trained with a combination of image patches derived from original and enhanced synthetic images outperformed the model trained with original digital histology images. Together, this study demonstrates the potential of customized GAN models to generate a large cohort of synthetic data that can train AI models to effectively grade PCa specimens. This approach could potentially eliminate the need for extensive clinical data for training any AI model in the domain of digital imagery, leading to cost and time-effective diagnosis and prognosis.

10
Examining Batch Effect in Histopathology as a Distributionally Robust Optimization Problem

Hari, S. N.; Nyman, J.; Mehta, N.; Jiang, B.; Rosenthal, J.; Sengupta, E.; Dietlein, F.; Umeton, R.; Van Allen, E. M.

2021-09-15 cancer biology 10.1101/2021.09.14.460365 medRxiv
Top 0.1%
11.3%
Show abstract

Computer vision (CV) approaches applied to digital pathology have informed biological discovery and development of tools to help inform clinical decision-making. However, batch effects in the images have the potential to introduce spurious confounders and represent a major challenge to effective analysis and interpretation of these data. Standard methods to circumvent learning such confounders include (i) application of image augmentation techniques and (ii) examination of the learning process by evaluating through external validation (e.g., unseen data coming from a comparable dataset collected at another hospital). Here, we show that the source site of a histopathology slide can be learned from the image using CV algorithms in spite of image augmentation, and we explore these source site predictions using interpretability tools. A CV model trained using Empirical Risk Minimization (ERM) risks learning this source-site signal as a spurious correlate in the weak-label regime, which we abate by using a training method with abstention. We find that a patch based classifier trained using abstention outperformed a model trained using ERM by 9.9, 10 and 19.4% F1 in the binary classification tasks of identifying tumor versus normal tissue in lung adenocarcinoma, Gleason score in prostate adenocarcinoma, and tumor tissue grade in clear cell renal cell carcinoma, respectively, at the expense of up to 80% coverage (defined as the percent of tiles not abstained on by the model). Further, by examining the areas abstained by the model, we find that the model trained using abstention is more robust to heterogeneity, artifacts and spurious correlates in the tissue. Thus, a method trained with abstention may offer novel insights into relevant areas of the tissue contributing to a particular phenotype. Together, we suggest using data augmentation methods that help mitigate a digital pathology models reliance on potentially spurious visual features, as well as selecting models that can identify features truly relevant for translational discovery and clinical decision support.

11
The FELIX Project: Deep Networks To Detect Pancreatic Neoplasms

Xia, Y.; Yu, Q.; Chu, L.; Kawamoto, S.; Park, S.; Liu, F.; Chen, J.; Zhu, Z.; Li, B.; Zhou, Z.; Lu, Y.; Wang, Y.; Shen, W.; Xie, L.; Zhou, Y.; Wolfgang, C.; Javed, A.; Fouladi, D. F.; Shayesteh, S.; Graves, J.; Blanco, A.; Zinreich, E. S.; Kinny-Koster, B.; Kinzler, K.; Hruban, R. H.; Vogelstein, B.; Yuille, A. L.; Fishman, E. K.

2022-09-25 radiology and imaging 10.1101/2022.09.24.22280071 medRxiv
Top 0.1%
10.9%
Show abstract

Tens of millions of abdominal images are obtained with computed tomography (CT) in the U.S. each year but pancreatic cancers are sometimes not initially detected in these images. We here describe a suite of algorithms (named FELIX) that can recognize pancreatic lesions from CT images without human input. Using FELIX, >95% of patients with pancreatic ductal adenocarcinomas were detected at a specificity of >95% in patients without pancreatic disease. FELIX may be able to assist radiologists in identifying pancreatic cancers earlier, when surgery and other treatments offer more hope for long-term survival.

12
Self-Configuring Capsule Networks for Brain Image Segmentation

Avesta, A. E.; Hossain, S.; Aboian, M.; Krumholz, H.; Aneja, S.

2023-03-03 radiology and imaging 10.1101/2023.02.28.23286596 medRxiv
Top 0.1%
10.9%
Show abstract

When an auto-segmentation model needs to be applied to a new segmentation task, multiple decisions should be made about the pre-processing steps and training hyperparameters. These decisions are cumbersome and require a high level of expertise. To remedy this problem, I developed self-configuring CapsNets (scCapsNets) that can scan the training data as well as the computational resources that are available, and then self-configure most of their design options. In this study, we developed a self-configuring capsule network that can configure its design options with minimal user input. We showed that our self-configuring capsule netwrok can segment brain tumor components, namely edema and enhancing core of brain tumors, with high accuracy. Out model outperforms UNet-based models in the absence of data augmentation, is faster to train, and is computationally more efficient compared to UNet-based models.

13
Creation of synthetic contrast-enhanced computed tomography images using deep neural networks to screen for renal cell carcinoma

Sassa, N.; Kameya, Y.; Takahashi, T.; Matsukawa, Y.; Majima, T.; Tsuruta, K.; Kobayashi, I.; Kajikawa, K.; Kawanishi, H.; Kurosu, H.; Yamagiwa, S.; Takahashi, M.; Hotta, K.; Yamada, K.; Yamamoto, T.

2022-01-12 urology 10.1101/2022.01.12.22269120 medRxiv
Top 0.1%
10.4%
Show abstract

ObjectivesTo elucidate if synthetic contrast enhanced computed tomography (CECT) images created from plain CT images using deep neural networks (DNN) could be used for screening, clinical diagnosis, and postoperative follow-up of small-diameter renal tumors by comparing the concordance rate between real and synthetic CECT images and the diagnoses according to 10 urologists. MethodsThis retrospective, multicenter study included 155 patients (artificial intelligence training cohort [n=99], validation cohort [n=56]) who underwent surgery for small-diameter ([&le;]40 mm) renal tumors, with the pathological diagnosis of renal cell carcinoma, during 2010-2020. Preoperatively, dynamic plain CT and CECT images were obtained. We created a learned DNN using pix2pix. We examined the quality of the synthetic CECT images created using this DNN and compared them with real CECT images using the zero-mean normalized cross-correlation parameter. We assessed concordance rates between real and synthetic images and diagnoses according to 10 urologists by creating a receiver operating characteristic curve and calculating the area under the curve (AUC). ResultsThe synthetic CECT images were highly concordant with the real CECT images, regardless of the existence or morphology of the renal tumor. Regarding the concordance rate, a greater AUC was obtained with synthetic CECT (AUC=0.892) than with only CT (AUC=0.720; p<0.001). ConclusionsThis study is the first to use DNN to create a high-quality synthetic CECT image that was highly concordant with a real CECT image. Synthetic CECT images could be used for urological diagnoses and clinical screening.

14
PathFlow-MixMatch for Whole Slide Image Registration: An Investigation of a Segment-Based Scalable Image Registration Method

Levy, J. J.; Jackson, C. R.; Haudenschild, C. C.; Christensen, B. C.; Vaickus, L. J.

2020-03-24 pathology 10.1101/2020.03.22.002402 medRxiv
Top 0.1%
9.9%
Show abstract

Image registration involves finding the best alignment between different images of the same object. In these tasks, the object in question is viewed differently in each of the images (e.g. different rotation or light conditions, etc.). In digital pathology, image registration aligns correspondent regions of tissue from different stereotactic viewpoints (e.g. subsequent deeper sections of the same tissue). These comparisons are important for histological analysis and can facilitate previously unavailable manipulations, such as 3D tissue reconstruction and cell-level alignment of immunohistochemical (IHC) and special stains. Several benchmarks have been established for evaluating image registration techniques for histological tissue; however, little work has evaluated the impact of scaling registration techniques to Giga-Pixel Whole Slide Images (WSI), which are large enough for significant memory limitations, and contain recurrent patterns and deformations that hinder traditional alignment algorithms. Furthermore, as tissue sections often contain multiple, discrete, smaller tissue fragments, it is unnecessary to align an entire image when the bulk of the image is background whitespace and tissue fragments orientations are often agnostic of each other. We present a methodology for circumventing large-scale image registration issues in histopathology and accompanying software. By removing background pixels, parsing the slide into discrete tissue segments, and matching, orienting and registering smaller segment pairs, we recovered registrations with lower Target Registration Error (TRE) when compared to utilizing the unmanipulated WSI. We tested our technique by having a pathologist annotate landmarks from 13 pairs of differently stained liver biopsy slides, performing WSI and segment-based registration techniques, and comparing overall TRE. Preliminary results demonstrate superior performance of registering segment pairs versus registering WSI (difference of median TRE of 44 pixels, p<0.001). Segment matching within WSI is an effective solution for histology image registration but requires further testing and validation to ensure its viability for stain translation and 3D histology analysis.

15
Supervised Learning for CT Denoising and Deconvolution Without High-Resolution Reference Images

Missert, A. D.; Hsieh, S. S.; Ferrero, A.; McCollough, C. H.

2023-09-02 radiology and imaging 10.1101/2023.08.31.23294861 medRxiv
Top 0.1%
9.8%
Show abstract

PurposeConvolutional neural networks (CNNs) have been proposed for super-resolution in CT, but training of CNNs requires high-resolution reference data. Higher spatial resolution can also be achieved using deconvolution, but conventional deconvolution approaches amplify noise. We develop a CNN that mitigates increasing noise and that does not require higher-resolution reference images. MethodsOur model includes a noise reduction CNN and a deconvolution CNN that are separately trained. The noise reduction CNN is a U-Net, similar to other noise reduction CNNs found in the literature. The deconvolution CNN uses an autoencoder, where the decoder is fixed and provided as a hyperparameter that represents the system point spread function. The encoder is trained to provide a deconvolution that does not amplify noise. Ringing can occur from deconvolution but is controlled with a difference of gradients loss function term. Our technique was demonstrated on a variety of patient images and on ex vivo kidney stones. ResultsThe noise reduction and deconvolution CNNs produced visually sharper images at low noise. In ex vivo mixed kidney stones, better visual delineation of the kidney stone components could be seen. ConclusionsA noise reduction and deconvolution CNN improves spatial resolution and reduces noise without requiring higher-resolution reference images.

16
RoMIA: A Framework for Creating Robust Medical Imaging AI Models

Anand, A.; Roy, K.; Krithivasan, S.

2023-04-11 radiology and imaging 10.1101/2023.04.10.23288377 medRxiv
Top 0.1%
9.6%
Show abstract

Artificial Intelligence (AI) methods, particularly Artificial Neural Networks (ANNs) have shown great promise in a range of medical imaging tasks. Despite their promise, the susceptibility of ANNs to produce erroneous outputs under the presence of input noise, variations, or adversarial attacks is of great concern and one of the largest challenges to adoption in medical settings. Towards addressing this challenge, we explore the robustness of ANNs trained for chest radiograph classification under a range of perturbations reflective of clinical settings. We propose RoMIA, a framework for the creation of Robust Medical Imaging ANNs. RoMIA adds three key steps to the model training and deployment flow: (i) Noise-added training, wherein a part of the training data is synthetically transformed to represent common noise sources, (ii) Fine-tuning with input mixing, in which the model is refined with inputs formed by mixing data from the original training set with a small number of images from a different source, and (iii) DCT-based denoising, which removes a fraction of high-frequency components of each image before applying the model to classify it. We applied RoMIA to create six different robust ANNs for classifying chest radiographs using the CheXpert dataset. We evaluated the models on the CheXphoto dataset, consisting of naturally and synthetically perturbed images intended to evaluate robustness. Models produced by RoMIA show 3-5% improvement in robust accuracy, suggesting that the proposed methods can be a useful step towards enabling the adoption of ANNs in medical imaging applications.

17
Detecting CTP Truncation Artifacts in Acute Stroke Imaging from the Arterial Input and the Vascular Output Functions

de la Rosa, E.; Sima, D. M.; Kirschke, J. S.; Menze, B. H.; Robben, D.

2022-06-21 neurology 10.1101/2022.06.16.22276371 medRxiv
Top 0.1%
9.4%
Show abstract

BackgroundCurrent guidelines for CT perfusion (CTP) in acute stroke suggest acquiring scans with a minimal duration of 60-70 s. But even then, CTP analysis can be affected by truncation artifacts. Conversely, shorter acquisitions are still widely used in clinical practice and are usually sufficient to reliably estimate lesion volumes. We aim to devise an automatic method that detects scans affected by truncation artifacts. MethodsShorter scan durations are simulated from the ISLES18 dataset by consecutively removing the last CTP time-point until reaching a 10 s duration. For each truncated series, perfusion lesion volumes are quantified and used to label the series as unreliable if the lesion volumes considerably deviate from the original untruncated ones. Afterwards, nine features from the arterial input function (AIF) and the vascular output function (VOF) are derived and used to fit machine-learning models with the goal of detecting unreliably truncated scans. Methods are compared against a baseline classifier solely based on the scan duration, which is the current clinical standard. The ROC-AUC, precision-recall AUC and the F1-score are measured in a 5-fold cross-validation setting. ResultsMachine learning models obtained high performance, with a ROC-AUC of 0.964 and precision-recall AUC of 0.958 for the best performing classifier. The highest detection rate is obtained with support vector machines (F1-score = 0.913). The most important feature is the AIFcoverage, measured as the time difference between the scan duration and the AIF peak. In comparison, the baseline classifier yielded a lower performance of 0.940 ROC-AUC and 0.933 precision-recall AUC. At the 60-second cutoff, the baseline classifier obtained a low detection of unreliably truncated scans (F1-Score = 0.638). ConclusionsMachine learning models fed with discriminant AIF and VOF features accurately detected unreliable stroke lesion measurements due to insufficient acquisition duration. Unlike the 60s scan duration criterion, the devised models are robust to variable contrast injection and CTP acquisition protocols and could hence be used for quality assurance in CTP post-processing software.

18
Beyond Algorithms: The Impact of Simplified CNN Models and Multifactorial Influences on Radiological Image Analysis

Mohammadi, S.; Mohanty, A. S.; Saikali, S.; Rose, D.; LynnHtaik, W.; Greaves, R.; Lounes, T.; Haque, E.; Hirani, A.; Zahiri, J.; Dehzangi, I.; Patel, V.; Khosravi, P.

2024-09-16 radiology and imaging 10.1101/2024.09.15.24313585 medRxiv
Top 0.1%
8.8%
Show abstract

This paper demonstrates that simplified Convolutional Neural Network (CNN) models can outperform traditional complex architectures, such as VGG-16, in the analysis of radiological images, particularly in datasets with fewer samples. We introduce two adopted CNN architectures, LightCnnRad and DepthNet, designed to optimize computational efficiency while maintaining high performance. These models were applied to nine radiological image datasets, both public and in-house, including MRI, CT, X-ray, and Ultrasound, to evaluate their robustness and generalizability. Our results show that these models achieve competitive accuracy with lower computational costs and resource requirements. This finding underscores the potential of streamlined models in clinical settings, offering an effective and efficient alternative for radiological image analysis. The implications for medical diagnostics are significant, suggesting that simpler, more efficient algorithms can deliver better performance, challenging the prevailing reliance on transfer learning and complex models. The complete codebase and detailed architecture of the LightCnnRad and DepthNet, along with step-by-step instructions, are accessible in our GitHub repository at https://github.com/PKhosravi-CityTech/LightCNNRad-DepthNet.

19
UCSF RMaC: University of California San Francisco 3D Multi-Phase Renal Mass CT Dataset with Tumor Segmentations

Sahin, S.; Diaz, E.; Rajagopal, A.; Abtahi, M.; Jones, S.; Dai, Q.; Kramer, S.; Wang, Z.; Larson, P. E. Z.

2026-02-12 radiology and imaging 10.64898/2026.02.11.26346096 medRxiv
Top 0.1%
8.2%
Show abstract

Current standard of care imaging practices cannot reliably differentiate among certain renal tumors such as benign oncocytoma and clear cell renal cell carcinoma (RCC), and between low and high grade RCCs. Previous work has explored using deep learning, radiomics, and texture analysis to predict renal tumor subtypes and differentiate between low and high grade RCCs with mixed success. To further this work, large diverse datasets are needed to improve model performance and provide strong evaluation sets. In this work, a dataset of 831 multi-phase 3D CT exams was curated. Each exam contains up to three contrast-enhanced CT phases. Tumor outlines or bounding boxes were annotated and registered to the image volumes. The pathology results for each tumor and relevant patient metadata are also included.

20
Tissue Region Segmentation In H&E-Stained Andihc-Stained Pathology Slides Of Specimens Fromdifferent Origins

Naghshineh Kani, S.; Soyak, B. C.; Gokce, M.; Duyar, Z.; Alicikus, H.; Yapicier, O.; Oner, M. U.

2025-01-17 pathology 10.1101/2025.01.16.25320663 medRxiv
Top 0.1%
8.1%
Show abstract

AO_SCPLOWBSTRACTC_SCPLOWWith the rise of digital pathology, integrating digital slides with deep learning-based decision support systems is becoming increasingly common in clinical practice. Tissue region segmentation which is distinguishing tissue from background/artefacts, is an important pre-requisite in many digital pathology pipelines both for the laboratories as their first step in digitalizing the glass slides of tissue samples and turning them to whole slide images (WSIs) using scanners, and also for DL researches such as region-of-interest cropping, tumor detection, cell segmentation. However, it is well known that WSI scanners can fail in detecting all tissue regions, due to the tissue type, or due to weak staining and this is because of their not robust enough tissue detection algorithms which makes segmentation of WSIs a challenging task. Hence, this study develops a fast, lightweight, accurate, CPU-ready DL approach, enabling fast and reliable tissue region segmentation model by training and testing it across seven different institutional H&E and IHC stained WSIs to result a strong in generalization with the 22 to 56 s/WSI inference time using CPU that markedly outperforms classical OTSU thresholding, particularly in preserving challenging or faint tissue regions by achieving notably higher and more consistent performance than OTSU, with median Jaccard and Dice scores of approximately 0.86 and 0.92, respectively, compared to OTSU whcih was between 0.56 and 0.72. Our approach provides a practical, open-source solution for resource-limited pathology settings. We publicly released dataset obtained from Bahcesehir Medical School, and code to foster benchmarking and further advances in efficient, deployable computational pathology. The model could be used in digital slide scanners to improve the scanning process and in the pre-processing stages of DL pipelines to prepare high-quality datasets.